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ABSTRACT 



A system and method of automatically adjusts watermark 
strength of a watermarked image based on the content of the 
image. The described system includes a process by which 
the correct watermark strength is estimated with a model of 
preferred watermark strength based upon human perception 
as measured with a test group. Preferred watermark strength 
of a watermark within a watermarked reference image is 
determined and parameter constants associated with mea- 
sured image texture values for the reference image are then 
determined. Image texture values are measured for a par- 
ticular image to be watermarked, and these determined 
parameter constants are used to predict the strength of the 
watermark for the particular image. Images are watermarked 
by modifying the luminance of those pixels that fall within 
a mask specifying the watermark design. In this way, the 
chromaticity of the pixel remains constant but the luminance 
changes. The amount by which the luminance is changed is 
dependent on the desired strength of the watermark: a 
stronger watermark demands a larger change in the lumi- 
nance. 

17 Claims, 5 Drawing Sheets 



COMPUTE TOfTURE -^203 



CCNefUTt UOOEL 
REUTMO WATZRUARK 
DfTENSnY TO IWCC 



OUTPVT lUACC y^20e 



05/20/2004, EAST Version: 1.4.1 



U.S. Patent Apr. 24, 2001 sheet 1 of 5 



US 6,222,932 Bl 




05/20/2004, EAST Version: 1.4.1 



U.S. Patent Apr. 24, 2001 sheet 2 of 5 US 6,222,932 Bl 



£ 



204 



WATERMARK 
IMAGE 



INPUT IMAGE 

I 



READ 
INPUT IMAGE 






COMPUTE TEXTURE 




x-206 


SELECT/ADJUST 

WATERMARK 
INTENSITY BASED 
ON THE MODEL 







-201 



-202 



-203 



205 



GENERATE MODEL 
RELAHNG WATERMARK 
INTENSITY TO IMAGE 
TEXTURE 



APPLY WATERMARK ^207 
TO INPUT IMAGE ^ 



I 



OUTPUT IMAGE y-ZOB 



FIG. 2 



05/20/2004, EAST Version: 1.4.1 



U.S. Patent Apr. 24, 2001 Sheet 3 of 5 



US 6,222,932 Bl 



READ IN PIXEL 
VALUES (R,G,B) 
BY LINE OR 
COLUMN 



301 



I 



CALCULATE TRISTIMULUS 
VALUES PER PIXEL (X,Y,Z) 



"X" 




"R" 


Y 


G 


Z 




B 



-302 



M« 



303 



TRANSFORM TRISTIMULUS VALUES JO 
UNIFORM COLOR SPACE L*a*b* 



L*= 



116(YAw)^^'^^^ -16 IF (YAw)^0.008856 
903.3(YAw) OTHERWISE 

a* = 500(X/XJ^Y3)_(YAJ$'/^J 
b* « 200(YAw)^^^^^-(Z/Zj^^^^^ 



STORE UNIFORM 
COLOR SPACE VALUE 
(L*,a*,b*) PER 
PIXEL FOR 
PROCESSOR 



-304 



FIG. 3 



05/20/2004, EAST Version: 1.4.1 



U.S. Patent Apr. 24, 2001 sheet 4 of 5 



US 6,222,932 Bl 



RECEIVE AND 
OMDE IMAGE 
INTO PORTIONS 
BY WINDOW 



I 



CALCULATE INERTIA : 
i=L-1j=L-1 

= 1 ^(i-j)2p(i.j|Ax^y). 
NO j=0 



I 



CALCULATE LOCAL HOMOGENEITY: 
i=L-1j=L-1 

l»0 j«0 ^ 



I 



CALCULATE ENERGY: 
l«L-1j=L-1 

= 1 I(P(i.j|Ax^y)2 
1=0 j=0 



I 



CALCULATE ENTROPY: 
i=L-1j=L-l 

= Z ^-P(i.j|A>,.Ay) LOG(P(i.j lAx^y)) 
i=0 j=0 



I 



STORE 
MEASURED 
TEXTURE VALUES 



FIG. 4 



05/20/2004, EAST version: 1.4.1 



f 



U.S. Patent Apr. 24, 2001 



Sheet 5 of 5 



US 6,222,932 Bl 



-1 -2 0 2 1 

-4-8 0 8 4 

-6 -12 0 12 6 

-4 -8 0 8 4 

-1 -2 0 2 1 

FIG. 5A 



-1 020-1 

-2 0 4 0 -2 
0 0 0 0 0 

2 0-40 2 
10-20 1 

FIG. 5B 



-1 020-1 

-4 0 8 0 -4 
-6 0 12 0 -6 

-4 0 8 0 -^4 

-1 0 2 0 -1 

FIG. 5C 



1 -4 6-4 1 
-4 16 -24 16 -4 
6 -24 36 -24 6 

-4 16 -24 16 -4 
1 -4 6-4 1 

FIG. 5D 



05/20/2004, EAST Version: 1.4.1 



us 6,2 

1 

AUTOMATIC ADJUSTMENT OF IMAGE 
WATERMARK STRENGTH BASED ON 
COMPUTED IMAGE TEXTURE 

This application claims the benefit of U.S. Provisional 
Application 60/051,096 filed Jun. 27, 1997. 

HELD OF THE INVENTION 

The invention relates to the field of digital imaging and 
more particularly to the fields of multimedia object security 
and image watermarking. 

BACKGROUND OF THE INVENTION 

Currently, digital capture of object images such as paint- 
ings and manuscripts, storage and retrieval of the images, 
and management of rights to the images is of growing 
importance with respect to information transfer and 
distribution, such as that of the Internet. Image watermark- 
ing has become an important and widely used technique to 
identify ownership and protect copyrights to images. An 
image watermark immediately identifies the owner of an 
image, and if properly constructed, can deter subsequent 
unscrupulous use of the image. Image watermarking is also 
used by stock photography vendors such a Photodisc, and 
others such as Digimarc. 

Ibcre are two types of image watermarks in common use: 
Visible image watermarks, such as the ones used by the 
Vatican Library and Lutherhalle collection, and invisible 
watermarks. The insertion of a visible watermark should 
satisfy two conflicting conditions: the watermark should be 
strong enough to be perceptible, yet it should be light 
enough to be unobtrusive and not mar the beauty of the 
original image. Though an invisible watermark is not 
perceptible, its strength can also be adjusted or selected. 
Typically such an adjustment or selection is made manually 
for both visible and invisible watermarks, and human inter- 
vention is required to adjust the strength of the watermark to 
the right level. This manual adjustment is satisfactory if only 
a few images are to be watermarked, but is unsuitable for a 
large collection of images. Thus, it is desirable to have a 
technique to automatically adjust or select the strength of the 
watermark based on the texture of each image. This will 
allow a large number of images to be automatically 
watermarked, thus increasing the throughput of the water- 
marking stage. 

Msible watermarking is well known in the art and may be 
summarized as follows. Visible image watermarking alters 
pixel brightness of selected pixels of the image correspond- 
ing to pixels of the watermark mask, which is typically done 
in the following manner. A visible image watermarking 
processor receives two images: the image of the watermark 
to be applied, such as the company logo, and the image to 
be protected. The watermark image may be binary, with a 
logic "0" representing background and a "1" representing 
foreground of the watermark. Only the pixels in the image 
to be watermarked corre^onding to the pixels of the fore- 
ground of the watermark image arc changed in brightness. 
Alternatively, the watermark image can be ternary, with "0*' 
representing no change in brightness, "1" representing an 
increase in brightness and "2" representing a decrease in 
brightness, and then a processor alters the brightness of 
selected pixels as dictated by the image of the watermark. In 
general, the watermark image can possess a multiplicity of 
gray levels. Further details about using watermark images 
with multiple gray levels may be found in U.S. Pat. No. 
5,530,759 awarded to Braudaway et al., entitled "Color 
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Correct Digital Watermarking of Images", incorporated 
herein by reference. 

The brightness of each pixel is altered by reducing or 
increasing it by a perceptually uniform amount, which is 

5 pre -determined by the user. In order to further define this 
process, XYZ is defined as a color space and L*a*b* as a 
uniformly perceptible color space. The XYZ color space was 
established by the Commission International de I'Eclairage 
(CIE), a body of scientists and illumination engineers, and 

-^Q this space is well known in the art. The XYZ color space is 
a standardized representation for color which takes into 
account the human eye's response to light. The XYZ values, 
also known as tristimulus values, represent the amounts of 
three primaries (chosen by the CLE) needed to match a given 

J 5 color. All visible colors can be described by some additive 
combination of X, Y and Z. Further discussion of the XYZ 
details may be found in Wyszecki and Stiles, Color Science, 
New York, Wiley 1967, which is incorporated herein by 
reference. 

20 Red, Green and Blue color values, or RGB values, may be 
transformed to the XYZ values, or CIE tristimulus values, 
by using equation (1). 





X 
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25 
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= Af, 


G 




Z 




B 



In equation (1), is a 3x3 scanner matrix which provides 
3Q a linear mapping between RGB values and XYZ values. 
A uniform color space is one in which colors that appear 
equally different from each other are represented by equi- 
distant points. However, neither the RGB color space nor the 
XYZ color spaces is a uniform color space. Modified color 
35 spaces, which are uniform color spaces L*a*b*, have been 
proposed, such as a color space based on luminance and 
chrominance values, or L*u*v* uniform color space. Given 
the RGB values (R, G, B) for a pixel, the RGB values are 
transformed into a perceptually uniform color space L*a*b* 
40 as follows. 

Let X^ Y^ and Z^ be the XYZ coordinates of the 
reference white point of an image. Then X, Y and Z can be 
transformed into L*a*b* values using equations (2), (3) and 
(4), and these methods are known in the art and described in, 
45 for example, Wyszecki, G. et al.. Color Science, John Wiley, 
1982. 

^ _ jnecK/yj^^^'-ie if (K/Kjfc0.oo8856 (2) 

~\903.3(y/y(^) otherwise 

50 

fl' = 5Q{i{XjXj"^^ - {Yl Yj'^^ (3) 
b" = 200(y / Yj^f^^ - (Z/^)"^J (4) 

55 The component related to image watermarking is L*, 
which approximates perceptually uniform brightness. Sup- 
pose the user determines AL* to be the perceptually uniform 
amount by which the brightness is changed in order to 
impose a watermark image value to the brightness value of 

60 a pixel. A higher value of AL* corresponds to a stronger 
impression of the watermark on the original image. Given 
AL*, new RGB values of (R,G,B) for the pixel using the 
color transformation are calculated using equations (5) and 
(6), which are described in, for example, Braudaway, Mag- 

65 erlein and Mintzer, "Protecting publicly-available images 
with a visible image watermark," in Proceedings, SPIE 
Conference on Optical Security and Counterfeit Deterrence 
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Techniques, vol. SPIE 2659, pp.126-132, February, 1996. 
First the new brightness Y is calculated from the current 
brightness Y using equation (5): 

/ y y 2/3 (5) 

^_y*3ihk) if (r/KJ. 0.008856 

Y 

/"^90l3^^* otherwise 

From equation (5), larger values of AL* result in larger 
changes to the brightness Y, which may make a visible 
watermark more obtrusive. 

The other tristimulus components, X and Z, are obtained 
by scaling the values by the ratio of Y/Y. With the new 
tristimulus components, XYZ, the new tristimulus values 
may be transformed to RGB color space values using the 
inverse of equation (1), given below as equation (6): 



R 




X 
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= m;^ 


Y 






Z. 



where M/^ is the inverse of matrix M^. 

New values of (R,G,B) do not change the chromaticity of 
the pixel, which maintains the color the pixel while changing 
its brightness. To thwart attempts to remove the watermark, 
the change in brightness, or-strength, for the pixel, AL*, may 
be varied randomly such that the mean AL* value equals the 
value selected by the user. 

Techniques for invisible image watermarking are also 
available, and some typical techniques known in the art arc 
as follows. One method employs modification of the least 
sigtiificant bits of the image to embed the watermark. Amore 
robust method of applying an invisible watermark which 
survives transformations such as resealing and compression 
employs computation of a two dimensional discrete cosine 
transform of the image (2D DCT) and then identification of 
n coeflBcients of highest magnitude excluding the DC coef- 
ficient (n is an arbitrary number). The watermark is then 
embedded into these n coefficients, for example, by adding 
to each coefficient the corresponding water mark strength. 
The inverse 2D DCT is then taken to obtain the watermarked 
image. If the DCT coeflScients are not significantly altered, 
the watermark will not be perceptible in the inverse trans- 
form. However, the more the DCT coefficients are altered, 
the easier it becomes to detect the presence of the watermark 
in the final image. Thus there is a tradeoff here between the 
invisibility of the watermark and its detectability. 

SUMMARY OF THE INVENTION 

An apparatus and method determines a watermark 
strength of a watermarked image, the watermarked image 
formed from an image and an image watermark, the strength 
level corresponding to a reference watermark strength of a 
reference image having a set of parameters associated witb 
a measured texture value of the reference image. The 
apparatus and method measure a texture value of at least a 
portion of the image; and calculate the watermark strength 
based on the measured texture value and the set of param- 
eters. 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other features and advantages of the present 
invention will become apparent from the following detailed 
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description, taken in conjunction with the accompanying 
drawings, wherein; 

FIG. 1 is a block diagram of an automatic image water- 
marking system in accordance with an exemplary embodi- 
5 ment of the present invention as employed in an image 
information provider network; 

FIG. 2 is a block diagram showing the functional blocks 
of an exemplary embodiment of a watermarking and 
strength adjustment process of the automatic image water- 
marking system of FIG. 1; 

FIG. 3 is a block diagram illustrating a calculation of pixel 
brightness or strength value suitable for use with an exem- 
plary embodiment of the present invention; 
j5 FIG. 4 is a block diagram illustrating a calculation of 
texture values with a co -occur ance matrix suitable for use 
with the texture measurement process of an exemplary 
embodiment of the present invention; 

FIG. 5A illustrates an energy mask suitable for use with 
20 the local energy texture measurement process of an exem- 
plary embodiment of the present invention; 

FIG. SB illustrates an energy mask suitable for use with 
the local energy texture measurement process of an exem- 
plary embodiment of the present invention; 
25 FIG. 5C illustrates an energy mask suitable for use with 
the local energy texture measurement process of an exem- 
plary embodiment of the present invention; and 

FIG. 5D illustrates an energy mask suitable for use with 
the local energy texture measurement process of an exem- 
plary embodiment of the present invention. 

DETAILED DESCRIFHON 

Overview 

FIG. 1 is a block diagram of an automatic image water- 
35 marking system 100 in accordance with an exemplary 
embodiment of the present invention as employed in an 
image information provider network. As shown, automatic 
image watermarking system 100 provides an strength water- 
marked image, shown as a stamped image 104, and system 
40 100 includes a digital image database 101 having a selection 
of images, a stamping information database 111 havkig a 
selection of watermark images, a computing imit 102 includ- 
ing image stamping processor 103, and a parameter database 
105. 

45 Stamped image 104 may be employed in an information 
distribution network which allows user systems 110 to 
access stamped images available from an image server 108 
through an electronic medium 109, such as the Internet. 
Each stamped image 104 is typically stored in a stamped 

50 image database 106 for retrieval by a image server 108. In 
cases where the stamped image 104 is encrypted, or where 
an invisible watermark is used which requires a verification 
key, image server 108 may access optional security infor- 
mation database 107 for necessary information. 

55 Digital image database 101 stores a selection of images 
which are to be "stamped" with an image watermark. For 
purposes of the following discussion, the term "image 
stamping** refers to the process of applying an image 
watermark, such as a company logo, to an image. The image 

60 may be stored, for example, as a digitized representation of 
pixels from a scanned image. These pixels may further be 
represented as Red, Green and Blue (R,G,B) values or as 
luminance and chrominance values. The stamping informa- 
tion database 111 stores a selection of watermark images 

65 which are used to stamp the image. The computing unit 102 
performs various database functions such as image and 
image watermark retrieval for signal processing functions 
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for the system 100, Computing unit 102 also includes image classification/* IEEE Trans. Systems, Man and Cybernetics, 

stamping processor 103 which receives both the image and vol. SMC-3 No. 6, pp 610-621, November, 1973, and 

the watermark image and performs the processing functions incorporated herein by reference; and (2) measures of local 

necessary to apply the image watermark to the image. A i^age energy based on energy masks which measure spec- 

^ parameter database 105 for determining the appropriate 5 t^al energy content in various bands, described in K.I. Laws, 

CSfedlefow'''''""' '° '""'^^ 'Textured Image Segmentation. PhD. Thesis, Dept. of Elec- 

'nC. 2 is'a block diagram showing the functional blocks ^^^^^ Engineering, Univ. Southern Califomia, 1980, and 

of an exemplary embodiment of a watermarking and incorporated herem by reference. 

strength-adjustment process of the automatic image water- lO Every digital image is comprised of a finite number of 

marking system of FIG. 1. First, at step 201, Oiejaput image strength levels, known as gray levels. For instance, a pixel 

to be watermarked is selected. In accordance with the of a black and white image may be represented by an 8-bit 

exemplary embodiment of the present invention, the input binary word, and each 8-bit binary word may represent up 

image may be automaticaUy selected as part of a sequence ^56 possible gray levels. For color images, where the 

of images to be stamped. Next, at step 202, the pixel values 15 . , . ^ j i i /n ^ . 

associfted with the selected image are read intoTpF^ESiiS F. P^'^ represented by three values (R,G,B), the measured 

s uch as computmg unit loi which provides the values to ^^^^^^ ^^^^ "^^^ computed m either of the red, green, or 

image stamping processor 103 (FIG. 1). ^^^^ ^^^^ channels, or may be a combmation of the chan- 

At step 203 the processor computes texture values for the nels using a weighted average, such as (R+G+B)y3. 

image. While the computation of texture values is described 20 One method measures a texture value related to the 

below, briefly, t his process calculates a texture value assq- co-occurrence matrix for a neighborhood of an input image, 

c iated with a corresponding portion , or several porUons_, of ^ ^elaUve frequency with which two image pixels separated 

the image. The portionfs) may be matrices ol pixel values of t /a a \ • *u * • uu u j 

I^— : — ^ , ^ ^ , ^ by a distance (Ax, Ay) occur in the given neighborhood, one 

the image, and the texture value may represent a measure of , i ^ ^i • j .i .7 .... . • i 

. , X — FTT f^r u : — ^-P . with grey level strength i and the other with strength i where 

a base strength of the portion , or of other characteristics of 25 . . • ^ - ^ ^ ^ , , ^- -s r \ 

the unage content ot the portion. Next, a watermark image ' ^"^^ J ^ ^^^^^^ ^1^°^^°^ (ij) of the two 

is selected at step 204, and then parameters associated with dimensional co-occurrence matnx, P (i, j, |Ax, Ay). The two 

a model for watermark sU-ength which use the texture values dimensional co-occurrence matrix, P (i, j , |Ax, Ay), defines 

are retrieved at step 205. the probability of going from gray level strength i to gray 

Using the texture values cnmnuted for the image in step 30 level strength j along the vector (Ax, Ay). Considering an 

203, the watermark values retrieved at step 204, and the MxN neighborhood of an image containing L gray levels 

model parameters determined at step 205, t he process at step ranging from 0 to (L-1), f (m,n) is defined as an image 

* 2 06 calculates the strength of the watermark to be applied , strength at row m and column n. The co-occurrence matrix 

„ adjusts the watermark strength, AL'^, applied to each pixel o f may then be defined, for example, as in equation (7): 

gierimage . ' 35 

Once the strength for the watermark applied to the image N~\yM-i^ (7) 

is determined, at step 207 t he processor annlies Jhe watei= . T\i, }\Lx,Ly)= ^ >^ 

mark to the image on, for example, a pixel by pixel basis, to "=i '"=a 
p rovide a watermarked image . At step 208, the watermarked 

image is provided to an external storage unit for access by 40 

users. Since the watermarking process may be accbmpHshed where 
using tristimulus components as defined in equations (2), (3) 

and (4) already described, once the watermark strength, j n) ~ i, and /(m + Ajc, n-t- Ay} = j 

AL*, is applied to the tristimulus values, equation (5) is used ^ = i ~ ^^^^ ~ 

to combine the watermark strength, AL*, with the pixel 45 otherwise 

strength, and then converted to RGB values using equation 

(6). 

Image Texture Measurement Th^s coccurrence matnx, P (IjlAx, Ay) is an LxL 

Before describing the operation of each step of HG. 2, the matrix. Based on this matrix, several texture measures can 

measurement of image "texture" is described. Image texture 50 be defined. Some of the more common exemplary measures 

refers to the surface markings or two dimensional appear- are given as follows in equations (8), (9), (10) and (11). The 

ance of a surface within an image. Image texture may be texture measure value of inertia, I, may be defined as in 

derived by combining three primitive texture types: (1) equation (8): 
strongly ordered textures, such as repetitive patterns (e.g. 

brick walls); (2) weakly ordered textures, such as surfaces 5S i=z^iy=n - (8) 

having a random appearance (e.g sand grains); and (3) S 2 (^'-^'^^'*('' -^1 ^>')- 

oriented textures, such as surfaces that have directionality '"^ 
(e.g. wood grain). Measuring texture and providing texture 

values is well known and is described, for example, in A. R. ^ , , t . 

Rao,ATaxonomy for Texture Description and Identification, 60 ^he texture measure value local homogeneity, G, may be 

Springer Veriag, 1990, and in H. Wechsler, "Texture Analy- defined as m equation (9): 

sis: A survey," Signal Processing, vol. 2. pp, 271-282, 1980, 

and which are incorporated herein by reference, ^*=^*-'^^ ^ p i •\Ax A 

Measures for image texture typically may be (1) texture ~ ^ 4^ 1 4- (/ - j)^ * 

features such as energy, homogeneity and entropy based on 65 
a co-occurrence matrix, described in K. Haralick, K. Shan- 
mugam and I. Dinstein, "Textural features for image 
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The texture measure value energy, E, may be defined as 
in equation (10): 

(10) 

^= Z Z (^'w'l^'M)'. 

1=0 j=0 

The texture measure value entropy, H, may be defined as 
in equation (11): 

i=L-lj=l^l (U) 
i-O j-O 

In another method, texture values which are measures of 
local image energy based on energy masks measure spectral 
energy content in various bands, and the measure of spectral 
content may be useful for texture discrimination. The texture 
energy within a portion of an image is calculated by con- 
volving the image portion with a selected one of these masks 
and computing well known statistics as texture values, such 
as the sum of the squared values of the resulting image 
convolved with the mask. FIGS. 5A through 5D illustrate 
energy masks suitable for use with the local energy texture 
measurement process of an exemplary embodiment of the 
present invention. 

Although the previous discussion described particular 
texture measures, the present invention is not limited to 
these embodiments, which are exemplary only. Other meth- 
ods for measuring texture parameters, such as the local 
orientation field, fractal dimension and analysis of 
repetition, for example, may also be used. 
Watermarking an Image and Adjusting Visual Watermark 
Strength 

Returning to FIG. 2, at step 202 the input image is read, 
and at this step the pixel values of the image may be in a 
form that requires a conversion to a uniform color space. For 
example, tbe pixel values of the image may be in an RGB 
color space, requiring a transformation of RGB values into 
a perceptually uniform color space L'*'a*b*. FIG. 3 is a block 
diagram illustrating a calculation of current pixel brightness 
or strength value suitable for use with an exemplary embodi- 
ment of the present invention. 

First, at step 301, each line, or column, of pixels for the 
image is read into the processor, each pixel may be repre- 
sented by an (R,G,B) value, with each of the R, G and B 
channels represented by, typically, an eight or sixteen bit 
value. Next, at step 302, the scanning matrix is received 
and is used to linearly map the received pixels from the 
(R,G,B) value to an (X,Y,Z) value. Next, at step 303, the 
(X,Y,Z) value is transformed to the uniformly perceptible 
color space as L*a*b* values, as described previously with 
respect to equations 2, 3 and 4. Then, at step 304, the L*a*b* 
values are stored for future use by the processor. 

At step 203 of FIG. 2, the processor may compute texture 
values based on texture features such as energy, homoge- 
neity and entropy based on the co-occurrence matrix. 
However, the present invention is not so limited, and this 
description is by way of example only to facilitate an 
understanding of the present invention. FIG. 4 is a block 
diagram illiistrating a calculation of texture values with a 
co-occurrence matrix suitable for use with the texture mea- 
surement process of an exemplary embodiment of the 
present invention. As shown, at step 401, the processor 
receives each pixel having new values corresponding to the 
uniformly perceptible color space, and then the processor 
divides the image into portions based upon the window 
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selected Next, at steps 402, 403, 404 and 405, the values for 
inertia, local homogeneity, energy and entropy, respectively, 
are calculated for each portion. Finally, at step 406, these 
measured values are stored for subsequent use by the image 

5 stamping processor to adjust the watermark strength. 

Next, the process of creating a model for the generation 
of appropriate watermark strength step 205 is described. In 
order to decide the strength of the visual watermark that has 
the best visual appeal, a simple model is created based on the 

10 response of a sample of human subjects. A sample pool of 
N human subjects is each presented with the original image 
watermarked at dififerent strengths, i.e. a reference image 
which has a watermark strength with different values of 
AL*. Each subject is asked to select the watermark strength 

15 which is appropriate; for example, if the watermark of the 
image is neither "too light" nor "too dark." Let S be a 
statistical average of the different watermark strengths 
selected by the subjects for a given image. As is known, 
increasing the number of human subjects within the sample 

20 pool provides a more "accurate" statistical value for S. 

In addition, since the object of studying a human sample 
space is to determine an appropriate perceived watermark 
strength, a model is created for the statistical measure S 
relating values for some mathematical measure, or 

25 measures, for each image presented. Therefore, the sample 
pool may be presented with a number of different images to 
determine the statistical value for S. Consequently, the 
responses of each subject is recorded for each original image 
over a set of several original images. For convenience, a 

30 "reference image" is a term used to refer to the image or the 
group of images which are presented to the human sample 
pool, and a "reference watermark strength'* is the statistical 
average of the different watermark strengths selected by the 
subjects for the reference image. 

35 For example, a Hnear regression model may then be 
developed relating S to the measured texture values of the 
image. For simphcity, assume one texture value X;i has been 
measured for the reference image before watermarking. The 
reference watermark strength, S, may be expressed as a 

40 function of x^. For example, a simple model is a Unear 
model, given in equation (12): 

S»ax^+b (12) 

With the different watermark strengths selected by the 
45 subjects from the sample pool for the reference image and x^ 
(the measured texture value for the reference image), the 
statistical value for S (mean subjective watermark strength) 
is determined using established methods, and the set of 
parameter values for a and b in the above equation (12) may 
50 be estimated, for example, by using the method of least 
squares. 

Once a and b is obtained from a sample pool using a group 
of watermarked images, the model is tested to ascertain that 
the model provides a good fit to the data, or the linear model 
55 is actually vahd. Then the texture measure x^ is used to 
predict the mean subjective watermark strength S. The 
predicted value is typically denoted by the S. In other words, 
the model captures the essence of subjective human assess- 
ments in this manner, and can automatically determine what 
strength S appears pleasing to the average human subject. 
This model and corresponding sets of parameter coeflScients 
are then provided to tbe processor and stored in parameter 
database of watermark strength 105 (FIG. 1.). 

The above linear model may be extended to two different 
texture measures as follows in equation (13): 

S-ojti+bxj+c (13) 
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In equation 13, and are two different measured texture As is known in the art, a method of invisible watermark- 
values, or measures of texture, and the set of parameter ing embeds the watermark in the DCT coefficients of the 
coefficients of the measured texture values, a, b, and c, may image. In accordance with the exemplary techniques of the 
again be determined through least squares. Determination of present invention previously described for adjusting the 
the set of parameter coefficients is again performed once 5 strength of a visual watermark, an alternative embodiment 
over the set of all watermarked images and subjects used of of the present invention alters selected DCT coeflBcients 
the sample pool. Subsequently, the same set of parameter values as a function of the measured texture values. For 
coefficients are used over any input image. For example, x^ example, the DCT coefiBdents may be altered to a larger 
may be the measured image mean and X2 the image variance. degree for an image with higher texture content as the 
As would be readily apparent to one skilled in the art, the watermark would be hidden belter in the texlural variations, 
extension to M different texture measures may be done in a Conversely, the DCT coefficients are only slightly altered for 
similar fashion. However, the present invention is not ^ image with lesser textural content, 
restricted by the choice of the precise texmre measure, the ^IjH^ preferred embodiments of the invention have been 
number of texhxre measures, or the type of model used Also, ^^^^^ described herein, it will be understood that such 
for the described exemplary embodiment, the procedure is embodiments are provided by way of example only. Numcr- 
illustra^ed by means of a Imear model, but non-hnear models ^5 ^^^^^^^^ ^^^^^^^^ substitutions will occur to those 

Finally, at^'s'tep' 206 of FIG. 2, the process of adjusting ^^^^^f. art without departing from the spirit of the 

watermark strength using the model for watemiark sirength y.^'^^^"* Accordingly, it is mtended that the appended 

of step 205 is ai follows. The image texture can either be claims a>ver all such variations as fall within the spmt and 

measured in step 203 globally (across the whole image), or 20 ^^°P® ^^}^^ invention, 

locally over an NxN window which slides over the image. What is claimed is: 

The estimate of S wiU apply over all pixels in the window 1- ^ '^f^^".'^ °f determining a watermark strength of a 

in which the texture is measured. Thus, if the whole image watermarked image, the watermarked image formed from aii 

. , . , t . J image and a watermark, the watermark strength correspond- 

IS used to measure texture only one value of S is calculated . ^ ^^^^^^^^ watermark strength of a reference image 

which determmes the value of AL* to be applied to the ^5 ^^^^^^^^^ ^^^^ having a set of parameters assod- 

image. In a preferred embodiment, AL*-S, this value of AL* ^ted with a measured texture value of the reference image, 

is then used to adjust all the pixels in the image. method comprising the steps of: 

The new brightness Y is then calculated in equation (14), a) changing the reference watermark strength until a 

which is performed in a similar manner to the process human observer indicates that the watermark is visible; 

described before with respect to equation (5): 5) measuring a texture value of at least a portion of the 

image; and 

IY + ^'^ f JL f ^ AL' if (r / Ki^j ^ 0.008856 ^^^^ ^) calculating the watermark strength for the watermarked 

38.667 vy^; image based on the measured texture value of the 

Y + Jj^^i' otherwise image and the set of parameters of the reference image. 

^^■^'■^ 2. The method of determining the watermark strength for 

a watermarked image as recited in claim 1, wherein the 

As before, the other tristimulus components, X and Z, rch^^acc image is one of a set of original images, the 

- , , n^r^r reference watermark Strength is determmed from a plurality 

may be obtained by scaling the values by the ratio of Y/Y. appropriate watermark strengths for each of the plurality 

TTie new tristimulus values may be transformed back to ^^^^ . ^^ parameters are further 

(R,G,B) values of the RGB ^lor space using the mverse of ^^^^^^^ ^jth at least one measured texture value of each 

equaUoD (1) in equation (15), m a simdar manner to the j^^^ „j ^^.^^ . 

process described before with respect to equation (6): 3 ^^^^ ^ ^ determining the watermark strength for 

45 a watermarked image as recited in claim 2, wherein the set 

^^^^ of parameters comprises a set of coefficients of a model, the 
set of coefficients in combination with the measured texture 
value of each of the plurality of original images providing 
the reference watermark strength. 

50 4. The method of determining the watermark strength for 

where M^"^ is the inverse of matrix M^. These values of a watermarked image as recited in claim 1, further compris- 

(R,G,B) are then stored by line, or column, as the water- ing the step of c) adjusting a current strength of at least one 

marked image in the step 208. selected portion of the watermark so as to provide the 

In an alternative embodiment of the present invention, calculated watermark strength for the watermarked image, 

several linear models are stored, with corresponding sets of 55 5. The method of determining the watermark strength for 

parameter coefficients. The computing unit 102 of FIG. 1 a watermarked image as recited in claim 1, wherein the set 

includes a resident program which compares the image to a of parameters is determined by (i) setting the reference 

representative reference image for several reference image watermark strength as a linear combination of at least one 

categories. If the image is "close" by a predefined image measured texture value of the reference image and the set of 

measure to one representative reference image, the models 60 parameters, and (ii) determining each parameter value of the 

and sets of parameters associated with that representative set of parameters using an estimation measure, 

reference image are used to adjust image watermark 6. The method of determining the watermark strength for 

strength. In a further embodiment, the multiple reference a watermarked image as recited in claim 5, wherein the step 

image sub-categories are used which are related to the type of measuring at least one texture value measures at least one 

of image watermark used. 65 of image inertia, image energy, image homogeneity, and 

Invisible Watermarking and Adjustment of Watermark image entropy for the watermarked image using a 

Strength co-occurance matrix. 
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7. The method of determining the watermark strength for 
a watermarked image as recited in claim 5, wherein the step 
of measuring a texture value measures a local image energy 
of at least a portion of the image using at least one energy 
mask. s 

8. The method of determining the watermark strength for 
a watermarked image as recited in claim 4, wherein the 
image includes a plurality of image pixel values each having 
a corresponding pixel strength, the watermark includes a 
plurality of watermark pixel values each having a corre- 
spending watermark pixel strength, the watermarked image 
is a combination of the plurality of image pixels with the 
plurality of watermark pixel values, and the adjusting step 
adjusts the watermark pixel strength of selected ones of the 
plurality of watermark pixel values combined with corre- 
spending ones of the plurality of image pixel values so as to 
provide the calculated watermark strength of the water- 
marked image. 

9. The method of determining the watermark strength for 
a watermarked image as recited in claim 4, wherein the 
image includes a plurality of frequency-domain transformed 
image coefficient values, the watermark includes a plurality 
of watermark values, the watermarked image is a combina- 
tion of the plurality of frequency-domain transformed image 
coefficient values with the plurality of watermark values, ^ 
and the adjusting step adjusts selected ones of the plurality 

of watermark values so as to provide the calculated water- 
mark strength of the watermarked image. 

10. An apparatus for setting a watermark strength of a 
watermark within a watermarked image, the watermarked 
image formed from an image and the watermark, the water- 
mark strength corresponding to a reference watermaris 
strength of a reference image and having a set of parameters 
associated with a measured texture value of the reference 
image, comprising: 25 

receiving means for receiving from at least one human 
subject, an indication that the watermark is visible in 
said reference image which corresponds to said image; 

measuring means for measuring a texture value of at least 
a portion of the image; 40 

calculating means for calculating the watermark strength 
for the watermarked image based on the measured 
texture value of the image and the set of parameters of 
the reference image; and 

adjusting means for adjusting a current strength of at least 45 
one portion of the watermarked image so as to provide 
the strength level for the watermarked image. 

11. The apparatus for setting the watermark strength as 
recited in claim 10, wherein the set of parameters associated 
with the measured texture value of the reference image is 50 
determined by (i) setting the reference watermark strength as 

a linear combination of at least one measured texture value 
of the reference image and the set of parameters, and (ii) 
determining each parameter value of the set of parameters 
using an estimation measuire. 55 

12. The apparatus for setting the watermark strength as 
recited in claim 11, wherein the measuring means measures 
at least one texture value corresponding to at least one of 
image inertia, image energy, image homogeneity, and image 
entropy using a co-occurance matrix and local image energy 60 
using at least one energy mask. 

13. The apparatus for setting the watermark strength as 
recited in claim 11, wherein the image includes a plurality of 
image pixel values each having a corresponding pixel 
strength, the watermark includes a plurality of watermark 65 
pixel values each having a corresponding watermark pixel 
strength, and the adjxisting means adjusts the watermark 
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pixel strength of selected ones of the plurality of watermark 
pixel values combined with corresponding ones of the 
plurality of image pixel values so as to provide the calcu- 
lated watermark strength. 

14. Apparatus for watermarking a plurality of images, 
each watermarked one of the plurality of images having a 
watermark strength, the apparatus comprising: 

receiving means for receiving from at least one human 
subject, an indication that the watermark is visible in a 
reference image which corresponds to said image; 
storage means for storing a plurality of watermarks and 
for storing a plurality of sets of parameters, each of the 
sets of parameters associated with at least one mea- 
sured texture value of said reference image; and 
processing means for processing a received one of the 
plurality of images with a selected one of the plurality 
of watermarks, the processing means including: 
measuring means for measuring at least one texture 

value of at least a portion of the received one of the 

plurality of images; 
selecting means for selecting one set of the plurality of 

sets of parameters based on the selected one of the 

plurality of watermarks and the received one of the 

plurality of images; 
calculating means for calculating the watermark 

strength based on the at least one measured texture 

value and the selected set of the plurality of sets of 

parameters; 

watermarking means for applying the selected one of 
the plurality of watermarks to the received one of the 
plurality of images to obtain a watermarked image 
having a current strength; and 

adjusting means for adjusting the current strength level 
of the watermarked image to the calculated water- 
mark strength to provide the one watermarked 
image. 

15. The apparatus for applying a watermark to an image 
as recited in claim 14, wherein each set of parameters 
associated with at least one measured texture value of a 
corresponding reference image is determined by (i) setting 
the reference watermark strength as a linear combination of 
at least one measured texture value of the reference image 
and the corresponding set of parameters, and (ii) determin- 
ing each parameter value of the set of parameters using an 
estimation measure. 

16. A method of determining a watermark strength of a 
watermarked source image, the watermarked source image 
formed from a source image and a watermark, the water- 
mark strength based on the source image and a reference 
watermark strength of a reference image and the reference 
image having a set of parameters associated with a measured 
texmre value of the reference image, the method comprising 
the steps of: 

a) selecting an image for use as a reference image; 

b) determining the reference watermark strength by 
adjusting the strength of the watermark applied to said 
reference image until a human observer indicates that 
the watermark has been seen; 

c) measuring the texture of said reference image; and 
developing a set of parameters of the reference image 
that describe the texture for said reference image; 

d) measuring a texture value of at least a portion of the 
source image; and 

e) calculating the watermark strength for the watermarked 
image based on the measured texture value of the 
source image, the reference watermark strength, and 
the set of parameters of the reference image. 
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17. A method of determining a watermark strength of a 
watermarked source image, the watermarked source image 
formed from a source image and a watermark, the water- 
mark strength based on the source image and a reference 
watermark strength of a reference image and a set of 5 
parameters associated with a measured texture value of said 
reference image, the method comprising the steps of: 

a) selecting a set of prototype images; 

b) for each of the prototype images; determining a just- 
visible watermark strength by adjusting the strength of 
the watermark applied to said prototype image until a 
human observer indicates that the watermark has been 
seen; and measuring the texture of said prototype image 
and developing a set of parameters that describe the 
texture for said prototype image; 
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c) selecting one of the prototype images as a reference 
image wherein the reference watermark strength is the 
just-visible strength of the selected prototype image 
and the set of reference parameters is the set of param- 
eters describing the texture of said selected prototype 
image; 

d) measuring a texture value of at least a portion of the 
source image; and 

e) calculating the watermark strength for the watermarked 
image based on the measured texture value of the 
source image, the reference watermark strength, and 
the set of parameters of the reference image. 

♦ ♦ * ♦ ♦ 
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